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Abstract. We provide conditions which yield a strong law of large num- 
bers for expressions of the form l/NJ2%=i F ( x (n( n ))> 1 ' ' , x (<)e( n ))) where 
X(n),n > O's is a sufficiently fast mixing vector process with some moment 
conditions and stationarity properties, F is a continuous function with poli- 
nomial growth and certain regularity properties and qi,i > m are positive 
functions taking on integer values on integers with some growth conditions. 
Applying these results we study certain multifractal formalism type questions 
concerning Hausdorff dimensions of some sets of numbers with prescribed as- 
ymptotic frequencies of combinations of digits at places qi(n), ...,qi(n). 



1. Introduction 

Nonconventional ergodic theorems which attracted substantial attention in er- 
godic theory (see, for instance, [3J, [12] and [2J) studied the limits of expressions 
having the form l/JVXn=i T^W/i • • ■ f e where T is a weakly mixing mea- 

sure preserving transformation, /j's are bounded measurable functions and qi's are 
polynomials taking on integer values on the integers. While, for instance, [3J and 
[12] were interested in L 2 convergence, other papers such as [2] provided conditions 
for almost sure convergence in such ergodic theorems. Originally, these results 
were motivated by applications to multiple recurrence for dynamical systems tak- 
ing functions f% being indicators of some measurable sets. 

Introducing stronger mixing or weak dependence conditions enabled us in |20j 
and [21) to obtain central limit theorems and invariance principles for even more 
general expressions of the form 

1 Wt] 

(1.1) -= J2 (HXMn)), -> - F) 

* n— 1 

where X(n), n > is a sufficiently fast mixing vector valued process with some 
moment conditions and stationarity properties, F is a locally Holder continuous 
function with polinomial growth, F = J Fd(/i X • • • x /i) and /i is the distribution 
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of X(0). In order to ensure existence of limiting variances and covariances we had 
to impose another assumption concerning the functions qj(n), j > 1 saying that 
qj(n) — jn for j — 1, k while qj{n), j > k are positive functions taking on integer 
values on integers with some (faster than linear) growth conditions. 

In this paper we are concerned with strong laws of large numbers (SLLN) for 
expressions of the form 



which can be proved under milder conditions that those required for central limit 
theorem type results. We still impose some mixing or weak dependence conditions 
but now the functions qj{n), n > 1 are allowed to be of much more general form 
than in [21], in particular, because we do not have to take care about limiting vari- 
ances. Recall, that the machinery of nonconventional ergodic theorems employed 
in [3], |12) . [2] and other papers can only work when the functions qj, j — 1 ,...,£ 
are polinomials while our methods do not require any algebraic structure of them. 
We pay a price for this, namely, imposing stronger mixing assumptions which are 
satisfied though for important classes of stochastic processes and dynamical sys- 
tems. 

In order to obtain our strong laws of large numbers we represent the sum in (jl.2[) 
as a sum of certain mixingales and then rely on the SLLN for mixingales obtained 
in |22j . Another approach which works in this situation under more or less the same 
assumptions is a martingale approximation similar to |21j together with a SLLN 
for martingales (see, for instance, Section 2.6 in [11]). 

Among more specific applications of our setup we can consider F(x±, ■■.,xi) = 



x^ ] ---xf\ Xj = {xf ] ,...,xf), X{n) = (Xi(n), X\ell(n)), X 3 {n) = l A] (T n x) 



for a dynamical system {T™} or Xj(n) — IU (£n) f° r a Markov chain {£ n } where 
Ia is the indicator of a set A. Then the expression (|1.2[) measures the frequency of 
arrivals of T n x or of £„ to the sets Aj at the respective times qj (n) . Recall, that the 
m-base and continued fraction expansions can be obtained via the multiplication by 
m and the Gauss transformations, i.e. Tx = {mi} and Tx — {1/x}, respectively, 
which are both exponentially fast ^-mixing with respect to many invariant measures 
(see [15] and [1]) and satisfy our assumptions. Denote by (j(x) the j-th digit of 
x G [0, 1) in one of these expansions. Then we can study the frequency of fc-th 
such that the £-tuple (( qi (k)( x ), —■> Cq e (k)( x )) coincides with a prescribed £-tuple of 
digits (ai, ai). For a full Lebesgue measure of points x £ [0, 1) such frequencies 
are determined by our SLLN and other frequencies may occur only for x belonging 
to sets of zero measure. This leads to an interesting question about Hausdorff 
dimensions of such exceptional sets which we study in the last section of this paper. 



Our setup consists of a p-dimensional stochastic process {X(n),n = 0, 1, ...} on 
a probability space (fi, J 7 , P) and of a family of er-algebras Fu cJ-,0<k<l<oo 
where we assume that J-qq is a trivial cr-field and J-ki C J~k'i' if fc' < fc and /' > /. 
We extend Tu also to negative k > — oo by defining Fu = Fqi for k < and I > 0. 
The dependence between two sub cr-algebras G,Ti. C T is measured often via the 



(1.2) 
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quantities 

(2.1) i&q, p (Q,'H) = snp{\\E[g\Q] — E[g]\\ p : g is H — measurable and \\g\\ q < 1}, 

where the supremum is taken over real functions and || • || r is the L r (Q, J-, P)-norm. 
Then more familiar a, p, <p & n d ^-voxxXng (dependence) coefficients can be expressed 
in the form (see [9], Ch. 4 ), 

a(g,n) = ^700,1(0,70, p{Q,H) = ™ 2 , 2 {Q,U) 

<t>{G,l-L) = \^oo,oo{G-,T-L) and ii){Q,T-L) = wi t00 (Q,H). 

The relevant quantities in our setup are 

(2.2) w qt p(n) — supzz7 9iP (J 7 _ 00 . fc , Tk+n.oo) 

k>0 

and accordingly 

a(n) = ^-n7oo,i(n), p(n) = ru 2 , 2 (n), <p(n) = ^oo,oo(n) and ip(n) = w 1 , 00 (n). 

Our assumptions will require certain speed of decay as n — > oo of both the mixing 
rates vj q p (n) and the approximation rates defined by 

(2.3) /3 p (n) = sup \\X(m) - E(X(m)\ T m - n , m+n ) \\ p . 

m>0 

Furthermore, we do not require stationarity of the process X(n), n > assuming 
only that the distribution (i of X(n) does not depend on n which we write for 
further references by 

(2.4) X(n) ~ /u 

where Y ~ Z means that Y and Z have the same distribution. 



Next, let F — F(xi, ...,xi), Xj € K p be a function on W such that for some 
l, K > 0,k e (0, 1] and all Xj, j/j e M p , i = 1, ...,£, 

(2.5) \F( Xl , ...,x e ) - F(y u y t )\ <K(l + J2 + E E I s * " fil" 

j=i i =1 j =1 

and 

(2.6) ^.....^l^ll + ^fel 1 ). 

j'=i 

Our assumptions on F are motivated by the desire to include, for instance, products 
F(xi, xi) = x\\x 22 ■ ■ ■ xu, where xt — (xn, xu) & K f , which are important in 
the study of multiple recurrence as described in Introduction. 

Our setup includes also a sequence of positive functions qi (n) < q 2 (n) < ■ ■ ■ < 
qi(n) taking on integer values on integers and such that for some positive e < 1, 

(2.7) qi{n) > qi-i(n) + en, i = 2, „.,£ and g,(n + 1) > qi(n) + e for all n > 1. 

In order to give a detailed statement of our main result as well as for its proof it 
will be essential to represent the function F = F(x\, x 2 , ■ ■ ■ , xi) in the form 

(2.8) F = F + Fi(si) + ■ ■ • + F e { Xl ,x 2 , ...,x e ) 
where 

(2.9) F = F= f F{x 1 ,...,x i )dn(x 1 )-'dn{xt), 
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(2.10) Fi(xi, ...,Xi) = J F(xi,X2, ...,xi) dfi(x i+ i) ■ ■ ■ dpi{xi) 

- J F(x 1} x 2 , ...,xe) dfi(xi) ■ ■ ■ dn(xi) 

for < i < £ and 

F e (xi,x 2 , ■ ■ ■ ,x e ) = F(x 1 ,x 2 ,...,x e ) - J F(xi,x 2 ,...,xt)dn(x e ) 
which ensures, in particular, that 

(2.11) J F l (x 1 ,x 2 ,-.-,x i -i,x i )dn(x i ) = V x x , x 2 , . . . , 
These enable us to write 

N I 

(2.12) S(N) = Y,F(X( qi (n)),...,X(q e (n))) = £>(W) 

n=l i=0 

where S (N) = NF and for 1 < i < £, 

(2.13) Si(N)= F i (X(qi(n)),...,X(q i (n))). 

l<n<N 

Following [22] we say that a sequence {«„, n > 0} is of size —1/2 if there exists 
a positive eventually nondecreasing sequence {L n , n > 0} such that 

^(nLnY 1 < oo, L n - L n _i = 0(L„/n) and a n = 0({n 1/2 L^ 1 ) . 

n>0 

For instance, any sequence with asymptotics Oin 1 !" 2 logn(loglogn) 1+l5 ) 1 for some 
8 > is of size —1/2. For each r > set 

(2.14) Y r = \\X\\: = E\X(n)\ r = J \\x\\ r d». 
Our main result relies on 

2.1. Assumption. With d = (£ — l)p there exist p, q > 1 and 9, m > such that 

1 1 l+2 9 

(2-15) - > - H h - and 7 m + 72g(,.+2) < oo 

2 p m q 

and the sequence w p ^ q {n) + f3®(n), n > 1 is of size —1/2. 

2.2. Theorem. Suppose that A ssumvtion \2.1\ holds true. Then with probability one 



(2.16) lim ±S{N) = F. 

AT— foo iv 

Our method relies on estimates from |21j which enable us to view for each i > 
1 the sequence of pairs {Fi(X (qi(n)) , X(qi(n))), F-aa qi r n )}%Li as a mixingale 
sequence, and so a strong law of large numbers for mixing ales from |22j can be 
employed. This gives an almost sure convergence of -kSi(N) to and by (|2.12[) 
Theorem 12.21 follows. Another approach which works in our situation is to rely 
on a martingale approximation of Si(N) similarly to [3T] and then to employ a 
strong law of large numbers for martingales (see, for instance, Section 2.6 in |16]V 
This method has to deal with approximations of Fi(X(q\(n)), X(qi(n))) by their 
conditional expectations and in order to avoid double limits as in |21j we can make 
this approximations with increasing in n precision. 
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In order to understand our assumptions observe that vo q . v is non-increasing in q 
and non-decreasing in p. Hence, for any pair p,q > 1, 

Furthermore, by the real version of the Riesz-Thorin interpolation theorem (see, 
for instance, [14], Section 9.3) if 5 e [0, 1], 1 < Po,Pi, qo, Qi < oo and 

1 _ 1 - 6 5 1 _ 1 - S 5 

p Pa pi q qo qi 

then 

™ q , P ( n ) ^ 2 (™qo, Pa ( n )) l ~ S ( w qupA n )) & ■ 
Since, clearly, w qiiVl < 2 for any q\ > p\ it follows for pairs (oo.l), (2,2) and 
(oo, oo) that for all q > p > 1, 

™ q ,p{ri) < (2a(n))f"«, ^q, P {n) < 2 1+ ? ~ « (p(n)) 1- ? + 5 
and Wq tP (n) < 2 1+ p(<ft(n)) 1 ~p. 
We observe also that by the Holder inequality for q > p > 1 and a G (0,p/q), 

P(q,r)<2 1 - a [p(p,r)} a 1 1 p ^_ a) 

p — qa 

with 7 r defined in (|2.14j) . Thus, we can formulate Assumption 12 . II in terms of more 
familiar a, p, cj>, and ^-mixing coefficients and with various moment conditions. 

The conditions of Theorem 12.21 hold true for many important models. Let, for 
instance, be a Markov chain on a space M satisfying the Doeblin condition 
(see, for instance, [17], p.p. 367-368) and fj. j = 1,.,.,£ be bounded measurable 
functions on the space of sequences x = (xi, i — 0, 1, 2, Xi € M) such that 
\fj(x) - fj{y)\ < Ce~ cn provided x = (xi), y = (y^) and x t = y, t for all i = 
0,1,..., n where c, C > do not depend on n and j. In fact, some polinomial 
decay in n will suffice here, as well. Let X(n) = (Xi(n), ...,X^(n)) with Xj(n) — 
/i(£n,£n+i)&H-2, ••■) and take er-algebras T k i, k < I generated by £ k , £ k +i, 6 then 
our condition will be satisfied considering {^„, n > 0} with its invariant measure 
as a stationary process. In fact, our conditions hold true for a more general class 
of processes, in particular, for Markov chains whose transition probability has a 
spectral gap which leads to an exponentially fast decay of the p-mixing coefficient. 

Important classes of processes satisfying our conditions come from dynamical 
systems. Let T be a C 2 Axiom A diffeomorphism (in particular, Anosov) in a 
neighborhood of an attractor or let T be an expanding C 2 endomorphism of a 
compact Riemannian manifold M (see [8]), fj's be Holder continuous functions and 
let X(n) = (Xi(n), ... 7 Xi(n)) with Xj(n) = fj(T n x). Here the probability space 
is (M, B, n) where \i is a Gibbs invariant measure corresponding to some Holder 
continuous function and B is the Borel tr-field. Let £ be a finite Markov partition for 
T then we can take F k i to be the finite cr-algebra generated by the partition r\ l i=k T l <^. 
In fact, we can take here not only Holder continuous fj's but also indicators of sets 
from Tu . A related example corresponds to T being a topologically mixing subshift 
of finite type which means that T is the left shift on a subspace S of the space of 
one-sided sequences £ = (£;, i > 0), & = 1, lo such that £ € S if 7r^f j+1 = 1 for all 
i > where n = (jrij) is an Iq x Iq matrix with and 1 entries and such that Tl n for 
some n is a matrix with positive entries. Again, we have to take in this case fj to be 
Holder continuous bounded functions on the sequence space above, /i to be a Gibbs 
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invariant measure corresponding to some Holder continuous function and to define 
J-fei as the finite cr-algebra generated by cylinder sets with fixed coordinates having 
numbers from k to I. The exponentially fast ^-mixing is well known in the above 
cases (see [8]). Among other dynamical systems with exponentially fast ?/>-mixing 
we can mention also the Gauss map Tx = {1/x} (where {•} denotes the fractional 
part) of the unit interval with respect to the Gauss measure G(T) = Jr TTx^x 
(see [I!]), as well as with respect to many other Gibbs invariant measures (see p]). 
The latter enables us to consider the number N a (x, n), a — (01, at) of fe's between 
and n such that the qj(k)-th digit of the continued fraction of x equals certain 
integer a,j,j = 1, ...,£. Then Theorem 12.21 implies a strong law of large numbers for 
N a (x, n) considered as a random variable on the probability space ((0, 1] ,13, G). In 
fact, our results rely only on sufficiently fast a or p-mixing which holds true for 
wider classes of dynamical system, in particular, those with a spectral gap (such 
as many one dimensional not necessarily uniformly expanding maps) which ensures 
an exponentially fast p- mixing. We will show how to derive from Theorem 12.21 the 
following result. 

2.3. Corollary. Let T be either a C 2 Axiom A diffeomorphism on a compact Rie- 
mannian manifold M considered in a neighborhood of an attractor or a C 2 expand- 
ing endomorphisms of a compact Riemannian manifold M or the Gauss map of 
the unit interval and let pi be an equilibrium state ( Gibbs measure ) corresponding 
to a Holder continuous function in the first two cases or an exponentially fast ip- 
mixing T-invariant (in particular, Gauss') measure (see Corollary 4-7.8 in [T],) in 
the latter case. Let Xj(n) = fj(T n x), j = !,...,£ where fj is either a continuous 
function or fj(x) — It Ax) where Tj is a measurable set whose boundary dTj has 
zero [i-measure. Finally, let F — F(x±, Xt) satisfies conditions of Theorem \2.S\ 
which means just that F is Holder continuous since its arguments are bounded here. 
Then the conclusion of Theorem \2.3\ holds true. 

Next, we discuss a continuous time version of our theorem. Our continuous 
time setup consists of a p-dimensional process X(t), t > on a probability space 
(f2, J 7 , P) whose one dimensional distributions do not depend on time and of a 
family of a-algebras T s t C T , — oo < s < t < oo such that T s t C T a 't> if s' < s and 
t' > t. For all t > we set 

(2.17) ^q,p(t) — SUpn7 gi p(J"_oo. s , J" s+t ,oo) 

s>0 

and 

(2.18) p{p, t) = sup \\X{s) - E[X(s)\T s - tiS+t ] \\ p . 

where vj q , p (G,'H) is defined by (|2.ip . It will suffice for our purposes to rely on 
Assumtion 12.11 concerning zu q>p (t) and j3(p,t) considered only for integer t. Let 
<7i(i) < (ft (i) < •• • < qe{t) be increasing positive functions satisfying the conditions 
(|2.7|) with t in place of n. Set 

,t I 

(2.19) S(t)= F(X( qi (s)),...,X(q e (s)))ds = J2Si(t) 
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where S (t) = tF, 

(2.20) Si(t)= [ F i (X(q 1 {8)),...,X{q i (s)))ds 

Jo 

and F, F, Fi are the same as in (f2"3j) . (I^TBj) and (j2^ - (l2"T[1) . Then we obtain 
2.4. Corollary. Under the conditions above with probability one 

lim -S(t) = F. 

t— >oo t 

Next, we discuss the fractal dimensions part of this paper. Recall that the 
multifractal formalism deals with computations of Hausdorff dimensions of sets 
having the form 

1 N 

{x: lim ^£/(r"x)=p}. 

n=l 

In our setup it is natural to study Hausdorff dimensions of more general sets 

1 N 

G p = {x: lim -J2F(h(T qi(n) x),...J i (T^x))=p}, 

n=l 

say, under the conditions of Corollary I2.3I When 

p = J ... J F(fi(xi), fi(x e ))dp(xi) ■ ■ ■ dfi(xi) 

then /i(G p ) = 1 by Corollary 12.31 while otherwise n(G p ) — and it is natural to 
inquire about the Hausdorff dimension of G p . 

We will not study here this general problem but consider a more specific ques- 
tion about Hausdorff dimensions of sets of numbers with prescribed frequencies of 
specific combinations of digits in m-expansions. Namely, for any x S [0, 1] and an 
integer m > 1 we can write 

x = '~ . — where aj(x) € {0, 1, m — 1}, j — 0, 1, ... 

i=i m 

and we allow zero tails of expansions but not tails consisting of all (to — l)'s. 
This convention affects only a countable number of points, and so it does not 
influence Hausdorff dimensions computations. For each x € [0, 1] and an £-word 
a = («!, c*2, ctg) € {0, 1, m — l} e define 

(2.21) N a (x,n) = #{fc > 0,k < n : (a qi{k} (x), a qe{k) (x)) = a} 

where #r denotes the number of elements in the set T. Denote by At — {0,1,..., to— 
l} e the set of all £- words and let p a > 0, a € At satisfy J2 a eA e Va = ^- For such a 
probability vector p = (p a , a € At) € M m define 

(2.22) Up = {x e (0, 1) : lim -N a (x,n) = p a for all a G AA. 

n— ^oo 77, 

We want to deal with the question of computation of the Hausdorff dimension 
HD{U P ) of U p . When I = 1 and qi(k) = k we arrive at the classical question 
studied in [3] and [10] by combinatorial means and in [6] via the ergodic theory. 

In order to relate the limit of ?7, _1 iV Q (a;, n) to the nonconventional strong law of 
large numbers (ergodic theorem) discussed before define the transformation Tx = 
{mx} where {•} denotes the fractional part. Identifying and 1 we can view T as an 
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expanding map of the circle. Now a%{x) = ao(T l x) and if a = (ai, «2, cee) € At 
and Tj = {a; : ao(x) = j} then 

n 

(2.23) 2V a (a;, n) = £ I r<n (T^«a;)Ir„ 2 (T»(*>aO ■ • • (T««x). 

Taking into account that {Tj, j = 0, 1, ...,rn — 1} is the Markov partition for T in 
this simple situation we arrive at the setup of Corollary 12.31 with F(xi, xg) = 
x\X2 ■ ■ ■ xi and fj(x) = Ir„. (»)) j = 1, ■ £ Observe that in place of the dynamical 
systems setup described above we could rely in this situation on the fact that that 
the digits a„, n > are independent identically distributed (i.i.d.) random variables 
with respect to the Lebesgue measure on [0,1], and so lr a . ° T n = I an=aj , i — 
1, ...,£, n = 0,1,... are also i.i.d. random variables so that mixing conditions of 
Assumption 12.11 trivially hold true. The following result answers our question in a 
specific situation. 

2.5. Proposition. Suppose that qi(k) = k for all k and there exists a probability 
vector r = (r , n, ...,r m _i) such that p a = n i= i r a t for any a = (ai, at) G At. 
Then 

Em—l n 
,=0 r 3 lnr 3 



(2.24) HD(U P ) = — ^ 

mm 

with the convention OlnO = 0. 

2.6. Remark. In view of (12.23)) for any T-invariant probability measure /i on [0, 1] 
with mixing properties fulfilling conditions of Theorem l2.2l it follows that /x-almost 
everywhere 

1 £ 
lim —N a {x,n) = T\ n(T ai ). 

n— >oo TL 

i=l 

Hence, if p = (p a , a € At) and there exists no probability vector r — 
(ro, r%, r OT _i) such that p a = n i=1 r ai then n(U p ) — for any /i as above, 
and so such /x cannot be used for computation of the Hausdorff dimension of U p 
(by one of methods where measures are involved) which complicates the study in 
this case. 

Now, consider a bit more complex situation. For each x G [0, 1] and a = 
(ai,a 2 ,...,at), f3 = (ft, a 2 , -,ft) € {0,1, ...,m- 1} £ set 

N a ,p(x,n) = #{fc > 0,fc < n : (a qi{k) (x), a qe{k) (x)) = a 

and (a qi ^ + i(x),...,a q ^ k ) + i(x)) = 0} 

and for each nonnegative matrix P = (j> a /3, oe,/3£ At) with ^ Q pPa/3 — 1 define 

(2.25) U F = {a; e (0, 1) : lim -iV a s(x,n) = p a « for all a, /3 € AA. 

n— »oo Ji 

Again, we can write N a p in the form suitable for application of Theorem 12. 2\ 
namely, 

n 

(2.26) N a , (x, n)=J2 ^ (T^x)l r ^ 2 (T^x) ■ ■ ■ 1^ (T^x) 

k=l 

where Tij = {x : ao(x) — i, a\{x) — j}. Then we obtain the following result. 
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2.7. Proposition. Suppose that qi(k) = k and there exists a nonnegative matrix 
R = (rij; i, j = 0, 1, m — 1) satisfying the following conditions: 

(i) some power of R is a positive matrix; (ii) *Yliij r ij ~ 1> Qi ~ ~Y^j=o r ij ~ 

E^o 1 nf, (Hi) P a p = IlLi r ai /3i ■ 

Then q = (go, <Zi, <Zm-i) is a positive stationary vector of the mx m irredicible 
aperiodic probability matrix Q = (qij), qij = <jf~ r^j and under the convention 
01n0 = 0, 

(2.27) HD{U P ) = "^t^ ■ 

In m 

2.8. Remark. Somewhat surprisingly Proposition 12.51 and 12.71 claim that in our 
circumstances the sets U p and U p have the same Hausdorff dimensions as if we 
were prescribing frequencies not of the whole ^-words or pairs of such words but 
just of their first digits or pairs of their first digits. 

2.9. Remark. It is easy to see that unless ^pPap = TlpPpa the set Up is empty, 
and so the condition (ii) in Proposition 12 . 71 is a necessary one. 



Next, we consider a similar to Proposition 12.51 problem concerning integer digits 
ao(x), ai(x), ... > of infinite continued fraction expansions 

1 



1 

ao(x) H 



ai(x) 



az{x) + ... 

for irrational numbers x g (0,1). We define again N a (x,n) and U p by (|2.21[) 
and (|2.22p taking into account that now there are infinitely many words a = 
(ai,..., ag) € {1,2,3,...} = Ae and, correspondingly, we have to prescribe in- 
finitely many frequencies p a > 0, a € At with Eaeyt f Pa = 1- We recall that the 
Gauss map Tx = {^} acts so that ai(Tx) = a^+i (x), i = 0, 1, 2, and so N a (x, n) 
can be represented again in the form (|2.23[) . For each infinite probability vector 
f = (n, ^2, ...) denote by Af(f) the set of T- invariant ergodic probability measures 
fi such that 



(2.28) 



Here, [(j + 1) 1 ,j 1 ) = {x E (0,1) : ao(x) — j} and for any n we set 
I(io,il, ...,i n _i) = {x £ (0,1) : ao(x) = io, a n -i(x) = i n -i\ which is called 
a rank-n basic interval. Denote by N(r ) the subset of N(f) consisting of measures 
v such that for ^-almost all x and all a = {ct\, ag) E At, 

1 l 
(2.29) lim -N a (x,n) = T\ r a, 

i=l 

By (I2.23|) and (]2.28[) we see that N (f ) contains all measures ^ € 7V(f) with sufficient 
mixing which make the process X a (n) = X a (x, n) = (Ir a (T n x), Ir a (T n x)) on 
the probability space ((0,1),^) to satisfy conditions of Theorem 12.21 We observe 
that not only the Gauss measure G(T) = Jr TTx' which is exponentially fast 
■0-mixing according to [15] . but also many other T-invariant Gibbs measures con- 
structed in [23] have sufficiently good mixing properties to satisfy conditions of 
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Theorem 12.21 Actually, the rank-1 basic intervals form a Markov partition for T 
whose action is essentially equivalent to the full shift on a sequence space with 
infinite alphabet. For such Markov transformations Corollary 4.7.8 from Q] gives 
conditions for their Gibbs invariant measures to be exponentially fast ^-mixing. 

2.10. Proposition. Suppose that q\{k) — k and there exists an infinite probability 

vector f = (ro, ri, ...) such that p a = Jli=i r a, f or an V a = ( a ij ••-> a t) € Ae- Then 
(2.30) 

max(-, sup — f— — , / n ) < HD(U V ) < max (-, sup — — , , r ) 
V 2' tf6 ^ f) 2/|lna:|d 1 /( a: ) ; " VW " V 2' 2/|lnx|di/(a:) ; 

where denotes the entropy of T with respect to /i and "sup " is set to be zero if 
7V(f) = 0. 

2.11. Remark. All results of this paper can be extended under appropriate con- 
ditions to random transformations and processes in random (dynamical) environ- 
ment. Namely, suitable (random) mixing conditions can be introduced similarly 
to [TO] and the corresponding relative strong law of large numbers can be proved 
relying on martingale approximations constructed combining methods of [19] and 
[21] . A relative version of Proposition 12.51 can be proved in the spirit of random 
base expansions from |18j . 

3. MlXINGALE REPRESENTATION AND PROOF OF SLLN 

We rely on the following result which is part of Corollary 3.6 from [21] . 

3.1. Lemma. Let Q and % be a-subalgebras on a probability space (Jl,J-,P), X 
and Y be d- dimensional random vectors and f = f(x,ui), x £ R d be a collection of 
random variables measurable with respect to T-L and satisfying 

(3.1) \\f{x,u)-f(y,u)\\ q < C(l + \x\ l + \yY)\x-y\ K and \\f(x,uj)\\ q < C{l + \x\ l ) 
where g > 1. Set g(x) — Ef(x,uj). Then 

(3.2) \\E(f(X, -)\G) - g(X)\\ v < c(l + \\x\\i+ 2 +2) )(w q:P (g,H) + \\X- E(X\g)\\ e q ) 

provided n— ^ > 8 > 0, ^^j + ^ + f with c — c(C, l. k, 6, p, q, v, d) > depending 
only on parameters in brackets. Moreover, let x = (v, z) and X = (V, Z), where V 
and Z are d\ and d— d\- dimensional random vectors, respectively, and let f(x,uj) — 
fiv.z.uj) satisfy H3.1\) in x — (v,z). Set g(v) — Ef(v, Z(lu),lu). Then 

(3.3) \\E(f(V, Z, -)\Q) - ~g(V)\\ v < c(l + ||*||£ 2 +2) ) 

x (w q , p (g,n) + \\v- E(v\g)\\ s q + \\z- e(z\h)\\°). 

Set Yi(n) = F i (X(q 1 (n)), X(q i (n))) — EF i (X(q 1 (n)), X{q i {n))) and denote 

Sri = J'-Qc.q i (n) for n > while taking g^ to be the trivial cr-algebra {0,0} for 
n < 0. Then by (j2~51) . ([2~o| , ([2~T5]) and ([3~3l of Lemma [Owe obtain that for some 
C\ > and all n, m and i = 1, ...,£, 

(3.4) lTO(n)|0«J|| 2 < C 1 (w M ( ft (m 1 n))+i3»( ft (m 1 n))) 
where p, q, 9 satisfy conditions of Assumption 12.11 and 

Pl (m,n) = mm ([ ,J [ J). 
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Observe that E(Yi(n)\Q^}_ m ) = if m > n and if < m < n then pi(m, n) > [em/3] 
by (|2~7)l . Hence, 

(3.5) ||S(y i (n)|^„J|| 2 <C 1 ( WM ([ e m/3]) + /3 9 e ([ £ m/3])). 

It follows also from (|2.3p and (|2.5[) - (|2.7p and the Holder inequality (see Lemmas 
4.1 and 4.2 together with Theorem 4.4 from [21]) that 

(3.6) \\Yiin) - E{%{n)\g n+m )\\ 2 < K\\(l + EtiCl^feW)!' 
+mX(Qi(n))\S$-m)\')) Eli |*(<7iW) - S(Xfe(n))|^ m )r|| 2 < C 2 /3°(m) 

for some C2 > 0. The estimates ()3.5() and (|3.6j) yield that Y"i(n), n > 1 is a mixingale 
sequence as defined in |22j and under Assumption 12.11 the conditions of Corollary 
1.9 from there are satisfied yielding that with probability one for i = 1, ...,£, 

(3.7) Jim hz i (N)-EE i (N))=Q. 

iV— *-oo 1\ 

Set a,(n) = (gj_i(n) + g,-(n))/2. By (12. lip and (|3.3I) we obtain that 

(3.8) |£F < (X(?i(n)),... J X(<fc(n)))| - |^(fi(X(gi(n)) J ... J X( 9i (n)))|J : L 00ia4(n) )| 
< C(n7 ?>p ([ife(n) - g 4 _i(n))]) + $([j(«i(n) - %_i(n))])) -)■ as n -»• 00 

by (|2.7p and Assumption 12.11 It follows that for i = !,...,£, 



(3.9) lim — EZdN) = 0, and so lim — Ei(iV) = a.s. 

bv (|3~7) yielding Theorem |2~2"1 in view of fl2T2j) . 1=1 
In order to derive Corollary |2.3l we recall that Holder continuous functions can be 
uniformly approximated by functions which are constant on elements (~}™ = _ n T l Gk i 
of the partition V"=-n (where Gk are elements of a Markov partition £) 
with an error decaying exponentially fast in n. Thus Theorem 12.21 holds when 
Xj(n) = fj(T n x) and fj, j = are Holder continuous. Then Theorem 12.21 

holds true also for continuous functions fj, j — !,.,.,£ since they can be uniformly 
approximated by Holder continuous ones and F is Holder continuous. Next, let 
fj = Irv with fj,(dTj) = 0. Given a Markov partition £ denote by fj- the set con- 
sisting of elements of the partition V<=-j T l ( which intersect Fj. Here we assume 
that Tj lie on a hyperbolic invariant set itself though the argument can be easily 
extended to a neighborhood of a hyperbolic attractor. For any S > there exists 

Is such that fJ,(T? \ Tj) < S for each I > 1$. For such an I set a» = IL,(o , j = 1, I. 

.. . . j 

Since F is Holder continuous we obtain that 

(3-10) I En=i F(h(T n x), ft{T"x)) - En=i F{9i(T n x), ...,g,{T n x))\ 

< C EU Eli (Iff ( T ^) " ^ (T**)) 

and the remaining part of Corollary 12.31 follows by the ergodic theorem applied to 
the right hand side of (|3TTU|) . □ 
In the continuous time case we set 

rn+l 

(3.11) Yi(n)= / (F t (X( qi (s)), ...,X(q e (s))) - EE(X( qi (s)), ...,X( qe (s))))ds 
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and check similarly to (|3.4|) - (|3.6|) that (Yi(n), Gn )°t =1 is a mixingale sequence 
where Q$ is the same as in (|3.4|l - (|3.6|l . Now Corollary 12.41 follows from [22] as 



before. □ 
4. Application to fractal dimensions 



Set 



N^ ) {x,n)=#{k>0,k<n: a k {x) = i}, 
N>y(x,n) = > 0, fc < n : a k {x) = i, a k +i(x) = j}, 

UW(x,ri) = {x£ (0, 1) : lim -N^\x,n) = n for all i] and 



n—t-oo fi 

(x, n) = {x£ (0, 1) : lim -N^ (x, n) = r« for all i, j}. 

n—>oo XI 



Since 



~N\ (x,n) — ^ia 2 ...a n (x 1 n) and 

N ij\ x > n )= X] N ia2 ... an . j02 ...p n (x,n) 



then for 



a 2 ,...,a„,/32,---,/3n 

T*i ^ Pict2...a n and Tjj ^ ^ Pia2---ot n \jft2---@n 

a2,...,ttTi ct2,...,a T1 ,/32,...,/3 T1 

we obtain that 

U v {x,n) C U^(x,n) and Up(x,n) C U^\x,n) 

provided p = (p a , a £ ^) and P = (p a p, a, (3 £ At). Hence, the upper bounds 
of Propositions 12 .5112 . 71 and 12.101 follow from the corresponding upper bounds from 
[5], |10) and |13j . Still, we provide below an argument yielding the upper bounds 
in Propositions 12.51 and 12.71 by the reason explained in Remark 14.11 

Denote by £ the space of sequences £ = (£o>£ii — ) with £ {0, l,...,m— 1} 
for all i > 0. For each probability vector r = (ro, ri, r m _i) denote by /z r = 
(ro, ri, r m _i) N the corresponding product measure on H, i.e. the probability 
mesure which gives the weight r ao r ai ■ ■ ■ r an to each cylinder set t B ao ai...a n — {£ = 
(£o)£i,--) G S : = cti for i = 0, 1, ...,n}. Observe that the map <p : S — » [0,1] 
acting by the formula y>(£) = Eti m * s one-to-one except for a countable 

set of points and since \i r has no atoms tp maps [i r to an atomless measure tp/i r on 
[0, 1]. Since fi r is invariant with respect to the left shift 9 : £ — > £ acting by = £ 
with £j = then y>/Lt r is invariant with respect to Tx = {mi} and 95 provides 
an isomorphism between (E,/x r ,0) and ([0, 1], yj/x r , T). Clearly, the conditions of 
Theorem 12.21 are satisfied here and applying it (see also Remark 12. 6p we conclude 
from (|2.23p that for ipfi r almost all x £ [0, 1], 

(4.1) lim™ ±N a (x, n) = lim™ ± ££ =1 1^ (T^ fc )x)Ir Q2 (T»C*>x) 
x ... x I Tat (T^x) = ULx Wr(r a< ) = nti r ai . 

It follows that 
(4.2) 

t 

ip/jL r (U p ) = 1 if p= (p a , a £ At) and p Q = JJ^a; whenever a — (a.\, ...,ag). 
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Suppose that rv > 0, j — 1, k while ri = if i =/= ij for any j. Set 
U + = {x G U p : a,j(x) £ {ii,i 2 ,...,ik} for any j = 0,1,2...}. 
Then by (|4.2[) and the definition of /j, r , 

(4.3) = 1. 

Observe that / ao a 1 ... Q , 1 „ 1 = yS aoai . - . an _ 1 is a subinterval of [0, 1] and let I n (x) = 
4 ai-«n-i if £ G 4 ai...a n -r Set nij(x,n) = #{i > 0,i < n : aj(x) = j}- Then 
for any x G U + we can write 

m— 1 

(4.4) In (piu, r (I n (x)) = rrij(x, n) lnr^. 

Clearly, |/n(aO| = where |/| denotes the length of I. Observe that if x G U p 
with p = (ro, ri, r m -i) then 

(4.5) lira — mj(x,n) — lim — -/V,- Q , a . (x, ri) = r-j . 

n-KxjR n-ioofi ^ — ' 

Hence, for any x G U + , 

In p/z r (7„ (x)) E^o* ^ In 



(4.6) lim 
n->oo m|i„(x)| mm 

which together with (|4.2I) implies (see Theorem 14.1 in jfJJ or Section 10.1 in [IT]) 
that 

(4.7) HD(U P ) > HD{U+) = _ gkZ^ = . S^lnr, 

mm mm 

with the convention OlnO = 0. 

Set I = m — k which is the number of j G {0, 1, m — 1} such that r\j = 0. 
Choose 8 > so small that 

(4.8) Tj > 5k- 1 if r 3 > ln(£r x ) < k' 1 ^ Info - (5A;- 1 ). 

j:r 3 >0 

Set = (r&^r^, ...,r^ ) _ 1 ) where rf ] = r 3 - Sk' 1 if rj > and rf ] = M" 1 if 
r, r = 0. Observe that by (TO . 



(4.9) ^ rj In rj a) > ^ rf } In r) S > . 

j=0 j=0 

Set 

7TI— 1 

= [0, 1] : limsup ( - - In (7 n (x))) < - V rf 5 lnrf } }. 

where /i r (<s) is the Bernoulli measure constructed by in the same way as [i r is 
constructed by r. As in (|4.4[) . 

771—1 

(4.10) ln<p/x rW (I„(a;)) = m J (x,n)lnr[ l5) , 
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and so by (JO), (|33|l . gSJ and (|4l0| . 

1 m— 1 

(4.11) C/ p c {x e [0, 1] : lim (--ln W rw(4W)) =-Y]r- i lnrf ) }cWW. 

If !/_(«) is constructed by p^ = {pa\ a e Ae) with p« = n*=i anc ^ a = 
(ai,...,a^) in the same way as [/ p is constructed by p then similarly to (14.2[) it 
follows that tpfi r (s) (U p (5) ) — 1 and since U p (s) C we conclude from here and 

mm) that 

(4.12) ^/^(W^) = 1 and HD{U P ) < HD(W (S) ). 

Again, since |/ n (x)| = m~ n then it follows from the definition of W^ s ' by the well 
known argument (see Theorem 2.3 in [5] or the proof of Theorem 14.1 in [5] or 
Proposition 4.9 in [TT] which also can be adapted to our situation) that 



(4.13) HD(W (S) ) < 



T rn-1 (S) j (6) 



->3= '3 

In m 

Letting 5 — > we obtain 

Am— 1 

HD(U P ) < - ' 



Em — i i 
i=Q r 3 llir 3 
P! - ] 

mm 

which together with (|4.7|) completes the proof of Proposition [23] □ 

4.1. Remark. Many papers and several books disregard the fact that the argu- 
ment in the first part of the proof above due to Billingsley works only when all 
rj's are positive while without this assumption it leads only to the lower bound 
of dimension. This gap was noticed and repaired first only in [18] (though it ap- 
peared in later papers, as well). The problem here is that when, say, rj = then 
ip/j, r (I n (x)) = provided a^(x) = jo f° r some i < n and for such x the right hand 
side of (|4.4[) becomes — oo which leads nowhere. In other words, the measure ip/j, r 
"disregards" such points while, on the other hand, the set of points x which have 
zero frequency of appearences of jo in their m-expansions is not countable and it 
cannot be disregarded in the Hausdorff dimension computation. In order to prove 
the result for general probability vectors (ro, r m -i) it is necessary to obtain here 
an appropriate upper bound for the Hausdorff dimension either by a combinatorial 
argument not related to Billingsley's ergodic theory one as in [TU] or by a simpler 
perturbation argument above due to my student Z.Hellman which appeared in a 
more general form in [18] . 



Next, we prove Proposition 12.71 Since for some n the matrix R n is a positive 
matrix then, clearly, each qi = ^ . must be positive and for each i, j there exists a 
sequence zi, Z2, in—i such that Ta 1 • • • r ^i n _ 1 j > 0. Then qu-.q^ ■ ■ ■ qi n _ l3 > 0, 
and so Q n is a positive matrix, as well. Clearly, J^. q^j = qj, and so q is the unique 
stationary vector of Q. Set Eq = {£ = (£o,£i, •■•) : Qi,i+i > f° r an i > 0} where 
Q = (qij, i,j = 0,l,...,m — 1). Let fiQ be the Markov measure on Hg,Q which 
assigns the weight q ao cia Q a 1 qa 1 a2 ' ' ' <Za„_ia„ to each cylinder set R aoai ...a n with all 
Q-i 6 A.+ . Then \xq is invariant with respect to the left shift on S g ,Q and its image 
ifHQ on [0, 1] is invariant with respect to T. Under assumptions of Proposition 12 .71 
the probability matrix Q is a transition matrix of an exponentially fast ^-mixing 
(finite) Markov chain (satisfying Doeblin's condition), and so the conditions of 
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Theorem 12 . 2 1 hold true here. We can also rely on Corollary 12.31 since /iq is a Gibbs 
measure for the left shift on 3 constructed by the function = — m <?£a£i' £ = 
(£o;£i,---) (see [5]). Since ipfiQ(Tij) — qiqij = ry we conclude from here together 
with (|2~TB)) . (|2~23|) and the definition of U P that <p[i Q (U P ) = 1. If Vq = v?S Q then 
taking into account that /uq(Hq) = 1 we obtain also that tpfiQ(Up n Vq) = 1. 
Now, for any x € Vq and I n {x) as above 

m — 1 

(4.14) kupnQ(I n (x)) = \nq ao{x) + ^ mij[x,n) In 

«,j=0 

where mij(x,n) = > 0, fc < n : afc_i(x) = i and afc(x) = j}. If x € t/p then 
similarly to (|4.5[t . 



(4.15) lim -mij(x,n) = r%j = Qiqij- 

n— >oo 71 

It follows that for any x 6 E/p fl Vq, 

,. In (^/j q (/„ (x) ) Ei",=o * ?w ln Hi 

4.16 hm /* — = J — . 

n->oo m|i n (x)| mm 

and so similarly to (|4.7I) . 

(4.17) FD(C7p) > ffD(tf P n Vq) = - ^f' g ' J gii . 

mm 

For the lower bound above we dealt only with points x G Vq where 3 0< ( K ) ai+1 ( x ) > 
for all i > 0. In order to obtain the upper bound we employ again a perturbation 
argument which in this case seems to be new. Let U, i — 0,1,..., m — 1 be the 
number of j = 0, 1, m — 1 such that = and set fcj = m — l\. Choose 6 > 
so small that for all i, j = 0, 1, m — 1, 

(4.18) r y > fcr 1 ^ if Py > and Inflf 1 *) < fcr 1 ^ ln((r tf - k^ 1 5)q^ 1 ). 

j:r i3 >0 

Set r W = r l3 - fcr 1 ^ if Py > and = 1^5 if r y = 0. Observe that J™=i r\f = 
qi and define qf) = r^q^ 1 yielding a positive m x m probability matrix = 
(?if )• By (glj we have 



(4.19) £r<,in«g>> E'-S'K- 

z,j=0 ij=0 

Set 

WW = {re G [0,1] : limsu Pn ^ 00 (-Iln WQ( „(/„(x))) 

, r-im-l IS) IS) -1m (<5) 

< - Ey=o r V max(l, q\ ' q i ) ln^. ; 

where /Jqw is the Markov measure constructed by QW and its unique stationary 
vector qW (i.e. q^Q^ = q^) in the same way as //q was constructed by Q and 
q. As in (j47T4|) . 

m— 1 

(4.20) ln(pfi QW (I n (x)) = ln? W (x) + £ m 4i (x, n) ln«?W, 
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and so by (|4J4]) . gUJ, (|4J9j) and (|4^0| . 



m — 1 



(4.21) C/p C {.t e [0, 1] : lim ( - - In (7„(x))) = - V r« lngjf} C W {5) . 
Let 

1 1 

U = {xe [0, 1] : lim ~N a p(x, n) = TT g £*>g<?> for all a, (3 e ^}. 

n— >oo 71 i J 

i=l 

Then for any x E U, 
(4.22) 

lim -m,ij(x,ri) = lim - V" N i>a2 ae j,i3 3 p t (x, n) = q\ S 'q\f 

n^oo Tl n— >oo XI — * 

0<a2 ,^2 5 ■ ■ ■ ,/3^<m— 1 

and by (|4.20j) for any x eU, 

^ m— 1 m— 1 

(4.23) Ikiln^ftl!)) - ^Iv^qg = ]T Wf- 



By Theorem 12.21 (or by Corollary 12. 3p we obtain that Hq(6) (U) = 1 and since 

U C by (|4~23l) and the definition of it follows that fi Q{S) (W^) = 1. 

Relying again on Theorem 2.3 in [5] (or see the proof of Theorem 14.1 in [B]) we 
conclude that 

(4.24) HD(U P ) < HDiW^) < ^ max(l, g ^)ln g y 

In m 

Since q is the unique probability vector satisfying qQ — q then q^ — >■ q as <5 — » 
and letting <5 — > in (|4.24[) we arrive at 

m — 1 i 

(4.25) HD(U P ) < " r """ / ". 

In m 

which together with ()4.17|) completes the proof of Proposition 12. 71 □ 
Concerning Proposition ^. lOl we explained already at the beginning of this section 
that the upper bound there follows from the upper bound derived in [13] . Next, we 
obtain the lower bound 

for any v € J\f(f) in the same way as in Theorem 1 from [7] since in addition 
to arguments there concerning continued fractions themselves we need only that 
v{U p ) = 1 (actually, already v{U v ) > is enough) which follows from (|2.29p . 

The remaining bound HD(U P ) > | can be proved similarly to Section 4 in [13] , 
Namely, we construct first points z € U p with a n (z) < n for all n > 1. In order to 
do this choose probability vectors (7*1 , , ...) such that > when 1 < k < n, 
Sfc^iPi™'' = 1 an d lim n ^.oo rjj. = ru for any k > 1. Consider independent integer 
valued random variables Y\, Yi, ... such that P{Y n = k} = rjj. . Applying Theorem 
12.21 we conclude similarly to (|4.1j) that for any €-word a = (ax,..., at) e Ai and 
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P- almost all lu, 

^ n I 

(4.26) Urn - M M) 1 ^ P^(*) M) • • • la, (^( fc) M) = J] • 

fc=l i=l 

Now, in order to satisfy our conditions we can take any z whose continued fraction 
expansion have digits a n {z) = Y n (uS), n = 1,2,... with uj such that (I2.26P holds 
true. 

Next, let < m(k) < I be integers such that k 2 + m(k) ^ Qi(k) for all k > 1 and 
i = 1, ...,£. For z £ Up constructed above and b > 1 define the set 

Ga(6) = {xe (0,1) : a fe 2 +m(fe) (x) e (6 fe3 ,26 fe2 ) and 

o„(j;) = a n (z) if n ^ fc 2 + m(fc) for some A;}. 

Then, clearly, G z (b) C C/ p . Following [T3] we construct a measure /i on G z (b) setting 
for each rank-m basic interval I m (%) containing x, 

n 

H(Im(x)) = l[b- k2 
k=l 

provided n 2 < m < (n+ l) 2 . Now, in the same way as in |13j we can show that for 
any > there exists b > 1 such that for all x G G z (b) , 

limM ^^-r,x + r) > l_ e 
r->-a In r 2 

It follows (see, for instance, Theorem 2.3 in [5] or Proposition 4.9 in [11]) that 
HD(U P ) > HD(G z (b)) > \ - 9 and since 6 > is arbitrary we obtain the required 
bound. Finally, we observe that if X)jli r i m J = 00 then HD(U P ) = | which 
follows from the latter lower bound and the upper bound of [T3]. □ 
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